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ABSTRACT 

A theoretical model specifying the underlying 
knowledge and procedures whereby human subjects can generate 
effective initial descriptions of scientific problems was formulated. 
The model is prescriptive since it does not necessarily try to 
simulate the behavior of actual experts nor assume that their 
performance is optimal. The model, elaborated in the domain of 
mechanics, specifies explicit procedures for redescribing problems in 
terms of a relevant knowledge base. To test the model, carefully 
controlled experiments were devised where human subjects were induced 
to act in accordance with alternative models and where their 
resulting performance was observed in detail. Such experiments, 
carried out with undergraduate physics students, showed that the 
proposed model is sufficient to generate excellent problem 
descriptions, that these markedly improve subsequent problem 
solutions, and that most components of the model are indeed necessary 
for good performance. Detailed data analysis also showed how the 
model predi ctably prevents the occurence of many common errors . Such 
a validated model of effective problem description provides a useful 
basis for teaching students improved scientific problem-solving 
skills. (Author/JN) 
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1. 



Abstract 

We formulate a theoretical model specifying the underlying knowledge 
and procedures whereby human subjects can generate effective Initial de- 
scriptions of scientific problems. This model Is prescriptive since It does 
not necessarily try to simulate the behavior of actual experts nor assume 
that their performance Is optimal. The model, elaborated 1n the domain of 
mechanics, specifies explicit procedures for redescrlblng problems In 
terms of a relevant knowledge base. To test this model we devised care- 
ful ly controlled experiments where human subjects are Induced to act In 
accordance with alternative models and where their resulting performance 
is observed In detail. Such experiments irrled out with undergraduate 

physics students, show that the proposed model Is sufficient to generate 
excellent problem descriptions, that these markedly Improve subsequent 
problem solutions, and that most components of the model are Indeed 
necessary fo r good performance- Detailed analysis of the data also shows 
how the model predictably prevents the occurrence of many common errors* 
Such a validated model of effective problem description provides a useful 
basis for teaching students Improved scientific problem-solving skills. 
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2. 

Problem solving Is a centrally Important and Intellectually demanding 
activity m any science. Hence it Is a challenging task to design Instruc- 
tional Methods for teaching students good scientific problem-solving skills. 
Effective Instructional design, however, depends -ruclally on an adequate 
understanding of how good scientific problem-solving performance Is 
achieved and of how novice students perform before Instruction. 

Recent years have witnessed considerable Interest In analyzing cogni- 
tive processes and knowledge structures underlying problem-solving perfor- 
mance in several scientific domains, e.g., In geometry (Greeno, 1978), 
physics tSlmon & Simon, 1978), or computer programming (Poison & Jeffries, 
1981). In particular, problem solving In the domain of physics has been 
studied by an especially large variety of approaches. A number of Investi- 
gations have examined the problem-solving performance of subjects of 
different levels of expertise (e.g., Simon & Simon, 1978; Larkln & Relf, 
1979; Larkin, McDennott, Simon, & Simon, 1980a; Chi, Feltovlch, & Glaser, 
1901). Other studies have Identified naive conceptions or misconceptions 
of physics students (e.g., Vlennot, 1979, Champagne, Klopfer, & Anderson, 
1980, McCloskey, Caramazza, & Green, 1980; Trowbridge & McDermott, 1980, 
1981; Clement, 198^, diSessa, 1982). Efforts have also been made to 
develop process models of physics problem solving. These have Included 
psychological models to describe and simulate the performance of human 
subjects of different levels of ability (e.g., Larkin, McDermott, Simon 
& Simon, 1980; Larkin, 1981), models recently summarized by Chi, Glaser, 
& Rees (1981). They have also Included some artificial-intelligence models 
embodied in computer programs less concerned with simulating human per- 
formance (e.g., de Kleer, 1977, Novak 19/7, Dundy, 1978, Bundy, Dyrd, 
luijer, Hellish, & Palmer, 1979; Dyrd 4 turning, 1980; Luger, 1981). 
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3. 

Although studies of the thought processes of experts and novlc* .> have 
yielded valuable Insights about effective problem solving, they have signi- 
ficant limitations. For example. It Is unwise to assume that the per- 
formance of experts Is necessarily optimal. Furthermore, educational 
efforts must do more than merely teach students to perform like experts. 
Instead It Is often necessary to teach students to use explicit procedures 
to accomplish tasks which experts perform almost automatically because they 
recognize patterns familiar to them as a result of years of experience. 

Accordingly, the work discussed In this paper has sought to study 
human problem solving from a more general point of view which transcends 
the Investigation of naturally occurring Intellectual functioning. In 
particular, our aim has been to specify cognitive processes and knowledge 
structures which lead to good human problem solving In a realistic scien- 
tific domain, without necessarily trying to simulate what actual experts 
do and without assuming that experts always perform optimally. Such a 
"prescriptive" approach Is clearly more general than a descriptive one since 
It allows greater freedom for theoretical inventiveness and controlled 
experimental manipulations. For example, although a prescriptive 
theoretical model of good intellectual performance may be partly suggested 
by naturalistic observations of experts, It may also be proposed on the 
basis of purely theoretical task analyses. Correspondingly, the sole 
criterion of validity of such a prescriptive model is that it lead o 
predictably effective performance when Implemented by a person, even i f It 
does not mimic what actual experts do. 

An analogy may help to clarify the distinction between a prescriptive 
point of view and a descriptive one. Imagine that a hypothetical cognitive 
scientist, working In the era of Julius Caesar, had been trying to formulate 
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a theoretical model of good performance In arithmetical problem solving. 
If this model had proposed the use of the modern place- value representation 
of numbers. It would have led to very good arithmetical performance and 
would thus have been an excrdent prescriptive model. However, It would 
have been an unsatisfactory descriptive model of the behavior of 
contemporary experts since they used Roman numerals. 

A prescriptive approach Is quite common In artificial Intelligence 
(Ai), but can also have considerable Interest In work on human cognitive 
Dioceses (Keif, 1979). In particular, by Identifying essential knowledge 
requited fo r good pel formance , It can help, to make explicit expert knowledge 
which Is often largely tacit. Furthermore, a prescriptive approach Is of 
essential importance for any efforts aiming to Improve human performance, 
to design effective Instruction, or to exploit the potentialities of 
pe r son - compu te r 1 n terac t i on . 

lhe prescriptive approach adopted In our work on human problem 
solving has some similarities to work In Al . (a) As In Al, our main 
Interest 's in formulating rwodels of effective functioning on complex 
intellectual tasks, without necessarily trying to simulate what human 
experts do However, since our models are specifically designed to be 
implement able by human Information processors rather than by computers, 
they presuppose explicitly that these information processors possess 
certain distinctly human limitations (e.g., limitations of short-term 
memory and processing speed) and human capabilities (e.g., abilities to 
understand natural language, to±construct and interpret diagrams, etc.). A 
corresponding advantage is that one may then focus primary attention on 
centrally Important'problem-solvlny processes, without the need to deal 
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explicitly with more basic prerequisite skills whose existence may be 
assumed without special analysis, (b) As In Al, the efficacy of a 
theoretical model of good performance is tested by expressing It 1n the 
form of an explicit "program* which can be implemented by an information 
processor. However, In our experiments (described more fully In later 
sections) the information processor Is a human subject, rather than a 
computer, and the program expressing the model consists correspondingly 
of instructions designed to be reliably executable by a human subject. The 
advantage of this method (unlike some foi.as of computer simulation) Is that 
a model of human cognitive functioning can be tested In a way which Is 
clearly valid and relevant to human subjects. Furthermore, once such a 
model has been validated empirically, 1t Is already in a form well 
adapted for human use. Hence It provides a ready basis for designing 
methods to teach problem-solving skills to human subjects. 

In seeking to specify the knowledge and procedures leading to good 
human performance in a scientific domain, we have focused our attention 
on problen-solvlng In basic college-level physics, specifically In the 
field of mechanics. This scientific domain Is realistically complex, often 
difficult for man/ students, and representative of other quantitative 
scientific or engineering fields. On the other hand, this domain Is 
sufficiently simple and well-defined to be amenable to a detailed analysis 
of underlying cognitive processes. Furthermore, such an analysis can draw 
upon insights derived from previous observations of experts and novices In 
this domain. 
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PRESCRIPTIVE MODEL OF PROBLEM DESCRIPTION 
Me have presented elsewhere a prescriptive theoretical model of 
effective problem solving In physics (Relf & Heller, In press). This 
model specifies some general procedures to be used In conjunction with a 
knowledge base about a particular scientific domain. The general 
procedures subdivide the problem-solving process Into three major stages: 
(a) the generation of an Initial problem description and qualitative 
analysis designed to facilitate the subsequent construction of a problem 
solution; (b) the generation of the actual solution by methods 
facilitating judicious decisions needed for efficient search; and (c) the 
assessment and improvement of this solution. The domain-specific knowledge 
base has characteristics specifically designed to facilitate the 
implementation of these procedures. In particular. It contains 
declarative knowledge of concepts and principles useful In the particular 
scientific domain. Is organized hierarchically and described at various 
levels of detail, and Includes explicit guidelines facilitating 
appropriate application of the declarative knowledge. 

The work described In the present paper has aimed to study specifically 
the generation of effective initial problem descriptions. Hence the study 
deals only with one aspect of a more encompassing model of effective problem 
solving. But this aspect is of crucial Importance since the initial 
description of a problem often determines how easily the problem can 
subsequently he solved or whether it can be solved at all. Furthermore, 
observations of actual experts provide relatively little direct Information 
about the description process since experts tend to describe problems 



ERIC 



6 



Prescribing Problem-solving Processes 

7. 

rapidly, and almost automatically, on the basis of large amounts of 
tacit knowledge. 

According to our prescriptive model, the generation of an Initial 
problem description can usefully be decomposed Into two successive stages. 
The first of these uses general domain-Independent knowledge to generate a 
"basic description" of a problem. This basic description merely ajms to 
identify explicitly the Information specified and wanted In the problem, to 
identify relevant processes and subprocesses In the problem situation* to 
introduce useful symbols, and to express the relevant Informatiofi In 
various convenient symbolic representations (e.g., In pictorial as well 
as verbal forms). 

The second stage of the description process aims to generate a 
"theoretical description" of the problem by deliberately redescriblng the 
problem 1n terms of the special concepts provided by the knowledge base 
for the relevant domain. In particular, the generation of such a 
theoretical description involves Identifying the special entitles of 
Interest In the problem, describing these entitles In terms of the special 
concepts provided by the knowledge base, and exploiting the known 
properties of these concepts. Since all principles in the knowledge ba.c 
are expressed in terms of these special concepts, the theoretical 
description of the problem makes all these principles readily accessible 
for the subsequent qualitative analysis and later solution of the problem. 
Hence the Initial theoretical description of a problem greatly facilitates 
the search for its solution. 

The basic description of a problem a»n usually be generated relatively 
easily by a procedure outlined in Relf and Heller (in press). The 
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generation of the subsequent theoretical description of a problem is more 
complex and is the main topic tllscussed In the following pages. Thus we 
shall tin>t outline a prescriptive motk'1 specifying the knowledge and 
procedures needed to geneiate good theoretical problem descriptions, with 
pai titular emphasis on problems In the prototype domain of mechanics, 
Ihen we shall delineate some special experimental methods useful for 
testing such a prescriptive model. After these general remarks, we shall 
describe In detail the Implementation of these methods by specific 
experiments. Finally, we shall discuss the results of these experiments 
and some of their implications. 

! I 1 ^etical Prob lem Rescr ipt 1 on jn Mechanics 
As dl i eady mentioned, the theoretical description of a problem alms 
to redescrthe the problem in terms of the concepts and information provided 
by the knowledge base for the relevant domain An effective knowledge base 

about any paitlculat domain should, therefore, have characteristics which 
facilitate the generation of a theoretical description of any problem 
encountered in thU domain. Accordingly, any such knowledge base should 
specify the entities of particular interest in this domain, the special 
concepts most useful for describing these entitles, and the important 
properties ot these concepts, furthermore, the knowledge base should 
include explicit guidelines speclf>ing how the preceding declarative 
knowledge Is to be used to describe any situation in this domain. 

I he preceding general comments can be elaborated into the following 
prescriptive model specifying the structure of the knowledge base and 
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associated procedures for generating a theoretical description of any 
problem In the domain of mechanics. 

The knowledge base about this domain specifies that the entitles of 
particular Interest in this domain are particles (i.e., objects small or 
simple enough to be adequately described by single points) and more 
complex systems consisting of many such particles {e.g., strings, rigid 
bodies, etc.). As Indicated In Figure 1, the knowledge base Introduces 
two different kinds of special concepts to describe such particles, 
"Individual descriptors" and "Interaction descriptors". The Individual 
descriptors describe particles by themselves, without regard to interactions 
between them. Some of these Individual descriptors are merely "intrinsic 
descriptors?" (such as "mass" or "electric charge") rised to characterize 
any particle; the other Individual descriptors ar^njotion descriptors" 
(such as "position", "velocity", "acceleration") specifically used to 
describe the motion of any particle. By contrast, the interaction 
descriptors do not describe individual oarticles, but the ^'nteractlo n 
between such particles.. For example, the "force" exerted on a particle by 
some other particle Is one such interaction descriptor, "potential energy" 
Is another one. ~. 

Insert Figure 1 about hore 

The knowledge base for mechanics specifies important properties of the 
preceding descriptors. In particular, "Interaction laws" specify how the 
interaction descriptors are related to the Individual descriptors of the 
interacting particles (e.g., how the force on one particle by another is 
related to the intrinsic characteristics of the particles and to their 
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Figure 1. Overview of the knowledge base for mechanics 
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positions). Such interaction laws are specified for various kinds 
of Interactions encountered In nature. These Interactions can be 
classified into the following two types: Some of these interactions are 
"long-range" because they are appreciable even If the interacting particles 
are separated by an appreciable distance. (The prime example is the 
gravitational Interaction of a particle with the earth.) The other 
Interactions are "short-range" because they are only appreciable when the 
Interacting particles are so close that they "touch" each other. (Examples 
are the Interaction of a particle In contact with a string or with the 
surface of a solid object.) 

Lastly, the knowledge base for mechanics specifies important "motion 
principles" which specify how the motion descriptors of particles change 
with time as a result of the Interaction between particles (e.g., how the 
acceleration of a paVtlcle depends on the force on this particle by other 
particles). These motion principles provide the science of mechanics 
with Its great predictive power. 

The preceding factual knowledge In the knowledge base for mechanics Is 
accompanied by explicit guidelines specifying how this knowledge is 
to be used for generating an explicit theoretical description of any 
problem in mechanics. According to our prescriptive model, these guidelines 
specify a description procedure consisting of the major steps summarized 
In Table 1. 

Insert Table 1 about here 

Note that the description procedure of Table 1 exploits extensively 
the specialized factual information in the knowledge base of mechanics 
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ldble 1 

Sundry of Procedure for Geuerdtlng a Theoretlcdl Problem Description 



* Relevant times terns: At each relevant time (previously Identified 
Tn the basic problan description) Identify those systems (particles or 
other special systems of Interest In mechanics) relevant In the problem 
because information about them is wanted, or because they interact 

with such systems directly or Indirectly. 

* Description 0 J relevant systems: At each relevant time, describe each 
relevant system as follows, Introducing convenient symbols and expressing 
simply related quantities in tenns of the same symbol: 

* ne^criotioH of Motion: Draw a "motion diagram" Indicating available 
Information about the position, velocity, and acceleration of each 
part icie. 

* Description of forces: Draw a "force diagram" Indicating available 
information about all external forces on the system. Identify these 
toices as follows: 

* long-range forces. Identify all other objects Interacting with 
the given system by long-range Interactions (ordinarily this Is 
just the earth Interacting by gravitational Interaction). For 
each such interaction , indicate on the diagram the corresponding 
foice and all available Information about it. 

* Short-range forces: Identify every other object which touches 
the given system and thus Interacts with It by short-range in- 
teiaction. For each such Interaction, indicate on the diagram 
the corresponding force and all available Information about it. 

* Checks of description: Check that the descriptions of motion and inter- 
action are qualitatively consistent with known motion principles (e.g., 
that the acceleration of each particle has the same direction as the 
total force on it, as required by Newton's motion principle ma * F). 
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(see Figure 1). ihus It describes explicitly every system of interest In 
this domain in tenns of the special motion descriptors (e.g., velocity 
and acceleration) and interaction descriptors (e.g., forces) specified by 
the knowledge base. It deliberately uses the classification of interactions 
into long-range and short-range types to specify explicit criteria for 
identifying all forces on a system. It also incorporates in the description 
known relations between all these descriptors. For Instance, the knowledge 
base of Figure 1 is used to Incorporate In the description known relations 
between Individual descriptors (e.g., relations between motion descriptors 
such as acceleration and velocity), known relations between Interaction 
descriptors (e.g., Uewton's third law specifying that the mutual forces 
between Interacting particles are of equal magnitude but opposite directions), 
and known relations specified by Interaction laws (e.g., relations 
specifying how gravitational forces, or forces exerted by strings, are 
related to the properties of the Interacting systems). Finally, the 
motion principles are used to check that the resulting theoretical 
description Is internally consistent. 

The description procedure of Table 1 will be elaborated more fully, 
and illustrated in specific cases, in connection with the experiments 
discussed later In this paper. 

Our prescriptive theoretical model would predict that the implementation 
of the description procedure of Table 1 by a human subject should lead to 
the following important consequences: 

(1) It should generate an explicit and detailed initial description 
of any mechanics problem in tenns of the special concepts of this scientific 
domain. In particular, such a description should be appreciably more 
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explicit than descriptions overtly generated by actual experts or than 
descriptions commonly presented In textbooks. 

(2) The description procedure of lable 1 should help human subjects 
to avoid many of the errors commonly committed by stt Jents. For example, 
the explicltness of the procedure should help to avo d errors due to the 
omission of relevant forces or due to the enumeratior of extraneous 
forces not produced by Interaction with any discernible objects. 

(3) The description procedure should somet imes lead to significantly 
easier reformulations of certain problems. (For example, a question 
asking "when a string becomes slack 1 * would automatically be translated Into 
a question asking "when the force by the string becomes zero". Similarly, 

a question asking "when a particle slides off a surface" would be 
translated Into a question asking "when the force on the particle by the 
surface becomes zero". Such reformulated questions, Involving the 
properties of familiar forces, are much more easily Interpreted and 
answered). 

(4) Ihe explicit problem description generated by the procedure of 
Table 1 should appreciably facilitate the subsequent solution of a problem 
(since this description incorporates already much information needed for 
the subsequent generation of equations and since It helps to limit 
appreciably the range of plausible alternatives to be considered In the 
decisions needed to generate such equations). Indeed, the generation of 
the Initial description of a problem may somet imes constitute the major 
difficulty of a problem and, once Implemented, may make the subsequent 
solution of the problem fairly trivial. 
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Methods for Testing a Prescriptive Model 
In the preceding sections we have outlined a prescriptive model 
whereby a human subject should reliably be able to generate useful Initial 
problem descriptions. As mentioned previously, the ultimate criterion of 
validity of such model Is not whether it simulates closely what actual 
experts do, but whether It leads to predictably good performance. 
Accordingly, the basic paradigm for testing the validity of such a 
prescriptive model is the following: Induce a human subject to act in 
accordance with the prescriptive model and observe whether the resulting 
performance Is effective 1n the predicted ways. 

The particular way In which we have sought to Implement this general 
paradigm Is In experiments In which a human subject Is induced to act under 
"external control". To clarify this experimental method by an analogy, 
consider the familiar situation where a pilot lands his or her plane in bad 
weather while following directions from an air-traffic controller on the 
ground. Under these conditions, a human Information processor (the pilot) 
makes extensive use of his or her sophisticated knowledge, but relegates 
higher-level control of this knowledge to external directions. This situation 
can be viewed as an experiment with the following interesting 
characteristics: (1) It allows a separation of high-level control knowledge 
from lower-level Implementation knowledge. For example, If the plane were 
to crash, the information retrievable from the taped conversation between the 
pilot and ground control would allow one to distinguish whether the crash 
occurred as a result of appropriate control directions improperly executed 
by the pilot, or whether It occurred as a result of faulty control 
directions. By contrast, If a pilot crashed the plane while flying 
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entirely under hu ut her own control, one could not distinguish whether the 
fault was In the pilot's higher-level control knowledge or lower-level , 
implementation knowledge. (2) A set of control directions, specifying how 
to land a plane, tan be viewed as a cognitive theory specifying how u human 
subject, with sophisticated human capabilities, can land a plane. In other 
words, such control directions would constitute a good theory of plane 
landing If, and only if, the correct execution of these directions leads to 
reliably effective landing of planes. (3) Such a validated theory of plane 
landing could ultimately be used as the basis of a theory of instruction 
for landing planes. In particular, such an Instructional theory would 
need to teach human subjects to Internalize, and carry out independently, 
the control directions which had previously been external. 

let us now turn from this analogy to external -control experiments 
designed to test other prescriptive models of human performance, e.g., 
models of effective problem description. To carry out such experiments, 
one needs first to design a "program" consisting of step-by -step directions, 
and associated knowledge, whereby a human subject can be guided to act in 
accordance with a specified model »>f per formance. For example, such a 
program might guide a human subject explicitly to execute the description 
procedure outlined in Table 1. The program should be problem-independent, 
i.e., equally applicable to any problem In the specified domain. Furthermore, 
one must make sure that the directions In such a program are properly 
matched to the characteristics and pre-existing knowledge of the human 
subjects for whom the program is designed. In particular, the Individual 
directions specified by the problem must be reliably interpretable and 
executable by the human subject. Ihey must also be formulated at an 
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appropriate level of detail, I.e., detailed enough to provide adequate 
guidance, but not so excessively detailed as to be burdensome or 
distracting to the subject. 

In the actual experimental procedure an Individual human subject Is 
then asked to carry out specified tasks (e.g., the description and 
subsequent solution of various problems^ by executing on-line successively 
stated directions according to a program specified by the model. While so 
doing, the subject Is asked to talk out loud about his or her thought* 
processes and the whole session Is tape-recorded. Detailed data can thus 
be gathered about the subject's written output and verbalized thought 
processes while responding to the external control directions. 

Such detailed observations allow one to obtain the following kinds of 
Information to test the proposed model of performance: 

(1) One can ascertain whether the proposed model of good perforUfewce 
Is, In fact, sufficient to lead to good performance. This can be done by 
determining whether subjects, working under external control In accordance 
with the model, do Indeed achieve good performance. (Note that such 
experiments do not Imply that the proposed model Is unique since other 
models might conceivably also lead to good, or even better, performance.) 

(2) One can verify that the prerequisite basic knowledge, which the 
model presupposes of human subjects, Is by Itself not sufficient to produce 
good performance. This can be done by letting subjects, with such 
knowledge, work wl thout external guidance of the model and observing that 
the resulting, performance Is poor. 

(3) One can ascertain whether selected features of the proposed 
model are, 1n fact, necessary to achieve good performance. This can be 
done by comparative experiments where human subjects work under external 
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control of a modified model which lacks selected features of the proposed 
model of good performance. Predictable performance deficiencies should 
then occur. 

(4) Finally, one can test whether the proposed model of good 
performance, when implemented, leads to specific predicted features In the 
resulting performance. For example, one can ascertain whether, and how, 
the occurrence of specific errors Is prevented when human subjects act In 
accordance with the model. 

It should be emphasized that the aim of such external-control 
experiments is to ascertain the merits of a proposed model of good 
performance, but not to teach. Subjects may, of course, learn Incidentally 
while working under conditions of external control. However, such learning 
need not occur because external control directions may not become 
internalized. For example, a subject, performing very well while working 
under external control, might revert to poor performance when external 
control knowledge is subsequently removed. 

EXPERIMENTS TESTING THE MODEL OF DESCRIPTION 
We implemented the yeneral approach, outlined 1n the preceding section, 
in specific experiments designed to test the proposed procedures for 
generating effective theoretical descriptions of problems In mechanics. 
In particular, these experiments were designed to answer the following 
questions: (a) Does the procedure lead to explicit and correct descriptions 
of the motion and Interaction of systems in various problems? (b) Do the 
resulting theoretical descriptions indeed facilitate the subsequent 
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generation of correct equations and hence of correct ultimate solutions 
of these problems? 

In the following sections we describe the method, results, and 
implications of an experimental Investigation to test these aspects of 
the prescriptive model. 

' Method 

The experiments compared the problem-solving performance of Individual 

subjects working under different external conditions. One group of 

subjects, the "model group 11 (M), worked on particular problems while guided 

by external control directions Implementing tfie^rcjposed model of good 

a 

performance. (These control directions were read to them by the experi- 
menter according to a written script.) Another group of subjects, the 
H mod1f led-model group" (M ), worked on these problems while guided by 
external control directions implementing a modified model different from 
the proposed model of good performance by the omission of certain selected 
features. (The performance of these subjects would be expected to 
deteriorate 1n predictable ways If these omitted features are necessary for 
good performance.) Finally a last group of subjects, the "comparison iroup 14 
(C), worked on these same problems without any external guidance. 

■ 

Subjects * 

The subjects in these experiments were 24 paid volunteers, all 
undergraduate students currently enrolled In the second course of an 
Introductory physics sequence at the University of California In Berkeley. 
These students had previously studied, 1n the first course of this sequence, 
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the relevant physics principles and types of problems used in our 
experimental study. Hence the subjects in this study could be assumed to 
have learned this relevant knowledge just a few months previously. 

Ihe subjects were selected randomly from those volunteers who had 
received a grade of B- or better in their last physics courses. These 
subjects were then randomly assigned to the three groups, eight in each 
group. 

Procedure 

A pretest, consisting of three mechanics problems, was first 
administered individually to each subject. Subjects were asked to talk 
aloud about what they were thinking whi le solving the problems, and their 
verbalized statements were recorded with their permission. During this 
and subsequent sessions, the subjects were provided with a printed summary 
of relevant mechanics principles to which they could refer at any time, 
liecause our interest was not In the subjects* knowledge about algebra or 
trigonometry, apparent errors in the application of such knowledge were 
pointed out or corrected by the experimenter when they occurred. 

Subjects in groups H and M* 'then received brief training to familiarize 
them with the directions they were subsequently going to be asked to follow,, 
Tills training consisted of a single practice run through the major steps of 
the problem- solving procedure. 

U*ch subject then returned for one or two subsequent sessions during 
which three problems, approximately equivalent to the pretest problems, 
were administered Individually. Groups M and H* were guided through the 
solution of these problems, while Group C again worked without external 
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guidance. The subjects were again asked to talk out loud and were tape- 
recorded. The subjects* written work and verbalized comments comprised 
the data for this study. 

Subjects working with external guidance were read^the standard 
directions one step at a time. Each direction hod to be Implemented by 
the subject before the next one was read. If a step was not performed, 
the directions were repeated. 

External Control Directions 

Standard external control directions were developed for use with 
subjects In groups H and M*. These directions provide very specific 
guidance through problem solutions but *re problem- independent— 1 .e. , the 
same directions are applicable to any mechanics problem that can be solved 
by applications of Newton's motion principle (his "second law"). A 
summary and comparison of the kinds of knowledge included in the directions 
for groups M and M* Is provided in Table 2. 

Insert Table 2 about here 

The external control directions specify procedures for accomplishing 
two major activities involved In problem solving: Constructing an initial 
- theoretical problem description and subsequently synthesizing the problem 
solution by generating constraints in the form of equations or inequalities. 

As indicated In Table 2, the modified M* version of the model consists 
essentially of a subset of the steps Included In the.fulVH version of the 
model of good performance. For example, the full model specifies explicit 
descriptions of both the motion and the interaction of systems; but the 
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Table 2 

Major Components of External Control Directions 
for Model (M) and Modified Model (M*) 



Components common 
to both snodels 



{tot Jon. Description 

Explicit mention of motion 
when generating equations. 



Additional components 
In model M only. 



Direction to draw separate 
motion diagrams Indicating 
position, velocity, and 
acceleration of each system. 

Special mentlcn of knowledge about 
motion (e.g., knowledge about 
components of acceleration for 
circular motion). 



Interaction Description 

Direction to draw separe'e force 
diagrams Indicating all forces- 
exerted on each system by all 
other systems. 



Specific algorl thm for 
enumerating forces. 

Special mention of knowledge about 
properties of Interactions (e.g., 
explicit rules for determining 
directions of forces). 



Checks on Oescr j [rt Jons 

Reminder to choose useful symbols. 



Check that all given information 
has been used. 



Check for consistency of 
motion and Interaction 
descriptions. 

Check that mutual forces are 
described correctly (equal 
in magnitude, opposite in 
direction) . 



Synthesis of Solution 

Assessment of current problem state. 

Explication of kinds of decisions 
to be madewiurlng application of 
motion principles (choice of princi- 
ple, of system, of direction). 

k 



21 



Prescribing Problem-solving Processes 

20. 

modified model includes only a description of Interaction. Furthermore, the 
full model specifies an explicit algorithm for enumerating alJ forces 
involved In the interaction; but the modified model specifies only that 
all forces acting on a system be indicated, without specifying in 
greater detail how these forces should be Identified. Thus the modified 
model corresponds roughly to the kinds of suggestions provided by a typical 
physics textbook (i.e., tc draw "free-body" force diagrams of systems, 
without providing expl lei t' rules for Identifying or describing relevant 
forces). 

The "full model also Includes methods for checking that the motion and 
Interaction of systems are correctly and conveniently described. One check 
Involves the comparison of motion and interaction descriptions to ensure 
their consistency. (This Is only possible in the full model where both 
motion and Interaction have been explicitly described.) A second check 
Involves examination of interaction descriptions to ensure that constraints 
Implied by Newton's third law have been considered— namely, that mutual 
forces (I.e., "actions" and "reactions") are described as equal In 
magnitude and opposite in direction. 

Directions for synthesizing solutions are essentially identical in 
both versions of the model. Of major Interest here are ths directions to 
choose explicitly a principle, a system, and a particular direction (or 
coordinate system) when applying Newton's motion principle to generate 
equations. 

The way in which the differences between the full and modified models 
were actually implemented Is exemplified in Table 3 which contains excerpts 
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A. 

from the scripts used to direct subjects through the enumeration of forces 

acting on a chosen system. 

<. 

Insert Table 3 about here 



p robl ems for Assessing Performanc e 

Three approximately matching pairs of mechanics problems (listed In the ^ 
Appendix) were selected from commonly used Introductory physics texts (French, 
1971; Resnick 4 lUlliday, 1977; Symon, 1971) and reworded slightly for 
increased clarity. The pairs of problems were split Into two sets, A and B, 
Half of the subjects received one set as a pretest and the other set during 
treatment sessions; the other half of the subjects received these sets in 
opposi te order. 

All of the problems used In the study could be solved by application 
of one fundamental motion principle, Newton's second law (ma = F). Two of 
the three pairs af problems (1A, IB; 3A, 3B) required non-trivial force 
descriptions because they Involved several forces (both long-range and 
Short-range) . these problems were included to allow assessment of procedures 
for enumerating forces. The third pair of problems (2A and 2B) required non- 
trivial motion descriptions; they involved systems In circular motion, the 
analysis of which is frequently performed Incorrectly by novices. These 
problems were included to allow assessment of procedures for describing ; 
motion. 
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Data Analysis 

In order to assess the quality of students' problem-solving behavior, it 
was necessary to identify and define explicit performance measures* Table 4 . 
summarizes the specific criteria used as measures of good performance— and 
the major classes of errors used to assess deficiencies of performance. 
Note that the first two measures In Table 4 were designed to reveal the 
adequacy of problem description, whether explicitly exhibited In diagrams 
(e.g., by subjects induced to act in accordance with the model) or only 
implicitly generated (e.g., by many subjects in the pretest or In the 
comparison group). Hence these measures assessed the completeness and 
correctness of the descriptive Information incorporated In the subjects* * 
equations, even If these subjects did not exhib any explicit prior 
description. 

Insert Table 4 about here 



Results 

The adequacy of every solution was assessed with respect to the 
performance measures listed in Table 4. The data In Table 5 and Figure 2 
show the mean number of each student's solutions (on the three problems 
solved during pretest or ^reatmerU sessions) that were correct on each of 
these measures. The data are summarized for students in each of the three 
treatment groups M» M*, and C. The rightmost columns in Table 5 indicate 
which of the differences between the^e groups are statistically 
significant. Table 5 and Figure 2 also summarize the performance of all 
24 students on the pretest. There were no significant differences between 
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Table 3 

Excerpts of External Control Directions 
for Constructing Interaction Descriptions 



Model H: 

E: Let*s now draw diagrams describing the forces on each 

system of Interest. Which system. ..do you wish to consider 
first/next? 

S: (Names a system M X". ) 

E: First name each system that touches X, Including those 
that exert applied forces. As you Identify each system, 
indicate all external contact forces exerted on X by 
that system. 

S: (Names systems and Indicates contact forces.) 

*MF NAMED SYSTEM INTERACTS BY SURFACE CONTACT: 

E: Remember, the force exerted by a surface ordinarily, 
although not always, has two components, the normal 
force and friction. Check to be sure whether both 
components exist In this case. 

Also, remember that the normal force Is perpendicular 
to, and directed away from, the surface exerting It. 
The friction force opposes the relative motion of the 
contact points; It opposes the motion of X relative 
to (Interacting system). 

E: Now name all external systems that directly Interact with 
X without touching It or through any other physical 
contact. Then Indicate the long-range forces exerted on 
X by each such system. 

S: (Names systems and Indicates long-range forces.) 

E: Are there any other systems touching X? 

S: (Indicates no others or names additional system(s) and 
Indicates contact force(s).) 

E: Are there any other systems directly Interacting with X 
by long-range forces? 

S: (Indicates no others or names additional system(s) 
and Indicates long-range force(s).) 

E: If not, you are finished describing all forces on X. 
DO NOT ADD ANY OTHERS. 
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Modified Model M* : 

E: Let's now draw diagrams describing the forces on each 
system of interest. Which system... do you wish to 
consider first/next? 

S: (Names a system "X".) 

E: Draw a force diagram Indicating aVL the forces exerted 
on X by all other systems. 

S: (Draws a diagram.) 

E: Are there any other forces exerted on X by any other 
systems? 

S: (Indicates no others or draws additional forces.) 



Note: E = experimenter, S ■ subject 
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Table 4 

Performance Measures and Error Types 



Performance Measure Major Error Types 



1, Adequacy ot motion Info rma t i on : Wrong direction of acceleration. 
Was' infoniiatTon about We magni- 
tude and direction of each Wrong magnitude of acceleration, 
system's acceleration correctly 

included in the equations? 

2. Adequacy of Interaction Missing forces(s) In equation. 
Informal 1 on \ " Wre "all requ i re d 

forces TncTuded In the equations? Wrong direction of a force. 
Were directions and magnitudes of 

those forces correctly indicated? Wrong magnitude of a force. 



3. Adequacy of constraint equat ions. 
We r e Ihe numbe V a ntTOhds of 
equations generated sufficient to 
determine a solution? Were all 
equations correctly 
Instantiated? 



Missing required equation. 

Incorrect Information contained 
In equation. 

Meaningless equation (e.g., 
inconsistent choices of systems). 



4. Correctness of final answer: Incorrect (or no) final answer. 

Was correct answer obTaTned? 



er|c 
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the various groups on this pretest, nor between these pretest results and 
the performance of the comparison group C In the treatment. 

Insert Table 5 about here 



Insert Figure 2 about here 



Sufficiency of the Model 

The purpose of this research was to evaluate selected aspects of the 
proposed model of good problem-solving performance In mechanics. The 
major question of Interest Is whether the kinds of procedures proposed by 
the model are sufficient for producing successful solutions. If the ki^ds 
of knowledge Included In the model are sufficient, students working in 
accordance with the model would be expected to perform well. 

The performance of subjects In group M, working under external 
control, Indicates that the proposed procedures did Indeed lead to very 
good performance. As Is apparent from Table 5 and Figure 2, these students 
performed nearly perfectly: All of their solutions contained every 
required equation, and all their equations contained correct and complete 
Intormatfon^about motion and Interaction. (The slightly lower Incidence 
of correct final answers resulted from incorrect combination of equations 
on problem 20; instead of performing a required vector addition, some 
students treated vectors like numbers.) 
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Table 5 

Mean Number of Solutions with Correct 
Performance on Specified Measures 



Performance 



. Statistical 
Treatment dl fferences c 



measures Pretest M M* C M>M* M*>C M>C 



Correct motion 1.83 3.00 2.63 1.63 
information 

Correct force 1.33 3.00 2.00 1.30 ** 
information 

Sufficient and 0.83 2.88 1.63 0.75 ** 
correct equations 

Correct final 0.79 2.75 1.30 0.63 * 
answer 



Note: Maximum score s 3.00. 
a n » 24. 

b n ■ 6 per group. 

c Kruskal-Wall1s Test results: *p/0.01; **£<0.O05. 
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Figure 2. Graphs of mean number of solutions tout of three) with 
correct performance on specified measures. 
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Inadequacy of Perf ormance llwj uided by the Model 

The previous results Indicate that subjects, Induced to act In 
accordance with the model, perform excellently. However, one may ask 
whether the subjects might not have performed equally well without 
guidance by the model , since they had studied mechanics In a previous course 
a few months before and might thus have the requisite knowledge to solve 
Independently the fairly standard kinds of problems used In our study. 

As indicated in Table 5 and Figure 2, the subjects' performance on the 
pretest, as well as the performance of the comparison group C, Indicates 
that the subjects* prior knowledge was definitely not sufficient to solve 
these kinds of problems adequately. On the average, the subjects solved 
correctly only less than one third of the pretest problems. Furthermore, 
only less than one third of their solutions contained enough equations to 
achieve a solution, and less than one half of these solutions Incorporated 
correct Information about both the motion and Interaction of the relevant 
systems. (The performance of the comparison group C In the treatment was 
virtually Identical to the performance of all subjects on the pretest.) 

The preceding results indicate that the kind of knowledge students 
acquire as a result of ordinary Instruction In an Introductory mechanics 
course is not sufficient to endow them with the ability to solve typical 
mechanics problems at the level of this course. However, It should be 
noted that the subjects In our study did have an adequate knowledge of 
basic physics concepts and principles, I.e., enough knowledge to interpret 
and Implement the external control directions used In our experiments. 
However, the additional procedural and factual knowledge provided by these 
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directions was necessary to help the subjects achieve good problem-solving 
performance. 

Necessity of Components of the Model 

The results already discussed show that subjects, working In 
accordance with the proposed model, perform very well on problem-solving 
tasks. However, one may ask whether all components of this model are 
actually necessary. For example, It might be that some of the procedures 
and knowledge Incorporated in the model are superfluous and that performance 
might be equally good (and perhaps more efficient) without these components. 

This question can be answered by comparing the performance of group M, 
which worked In accordance with the proposed model, with the performance of 
group M* which worked in accordance with a modified model omitting certain 
components of the proposed model. (See Table 2.) If these knowledge 
components, contained In the full model but deleted from the model used to 
guide group M*, were In fact necessary for good performance, the observed 
performance of jroup M* should be less adequate than that of group M. In 
particular, since the major differences In the models, and In the 
experimental directions based on them, lay In the completeness and 
expllcltness of^he initial problem descriptions, the descriptions of motion 
and Interaction^ group M* would be expected to be Inferior to those by 
cjroup M. Correspondingly, the subsequent equations generated by subjects 
in group M*, and hence also the final problem answers obtained by them, 
should be less often correct than those generated by subjects in group H. 

The data in Table 5 and Figure 2 reveal essentially this pattern of 
results. All results are statistically significant, except in the case of 
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motion description, where the performance of Group H* was not significantly 
poorer than the perfect performance of Group M. It thus appears that the 
kinds of knowledge Included In the model are both sufficient and necessary 
for achieving good problem solutions. 

Detailed Analysis of Subj e cts' Performa nce 

A closer examination of the subjects' performance provides Insights 
Into the ways In which the proposed model facilitates good performance. 
In this section we discuss some specific examples of typical difficulties 
subjects encounter during problem solving. For each such example, we 
Indicate the particular components of the model that lead to good 
performance by reducing such difficulties and preventing common errors. 

Omission of relevant forces . One of the most common errors committed 
by subjects, working unaided without external control, Involved the 
omission of some relevant forces acting on a system. Indeed, about 75X of 
the subjects omitted some relevant forces In at least one of their pretest 
problem solutions. 

These difficulties In problem description may be illustrated by 
problem 3B used In our study. This problem (Illustrated In Figure 3 and 
described more fully In the Appendix) deaJs with two blocks A and B 
connected by a string passing over a fixed pulley. The block B may slide, 
with friction, relative to the horizontal floor beneath it and relative to 
the block A on top of it. It Is desired to find the magnitude of the 
force F Q needed to pull the block B to the left\^th constant velocity. 
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insert Figure 3 about here 

The description procedure, specified by the model summarized In 

T«t>le 1> would describe the motion of block B by Its velocity v and 

acceleration a, as Indicated In Figure 3. It would also describe the 

interaction of this block by using the procedure of Table 1 to identify 

all forces on this block. Thus it would first Identify the long-range 

gravitational force F g on block B by the earth, Then It would Identify 

all other objects which touch the block B and correspondingly Identify all 

the short-range forces acting on B. As indicated In Figure 3, these are 

the force F rt applied by the system pulling this block, the tension force T 
o 

by the string, the normal and friction forces (N and f) by the floor, and 
the normal and friction force (N 1 and f 1 ) by block A. 

Identification of all these forces presented particular difficulties 
for the subjects ungulded by the model. For example, the friction force f 
on B by block A was omitted in half- of the pretest solutions of this 
, problem. The normal force N 1 on B by block A» and the tension force T 
on B by the string, were omitted in 25% of the pretest solutions. 

These errors were eliminated entirely f 1n the solutions of subjects 
guided by the model. The reason is that the model (Table 1) contains an 
explicit algorithm which enumerates all short-range forces by identifying 
all objects which touch the system of interest— and the Identification of 
objects touching a given system is trivial for human subjects/ Furthermore* 
the algorithm Includes an explicit reminder of factual knowledge in the 
knowledge base, I.e. > that the force exerted by a surface consists 
ordinarlly^of two component forces (the normal and friction forces) 
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Figure 3. Problem 3A involving two blocks connected by a string, with 
motion and force descriptions of block B. (Forces frequently omitted by 
subjects are Indicated by dashed arrows.) 
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perpendicular and parallel to the surface. Hence the explicit description 
eliminates automatically the conmon error of omitting some short-range 
forces acting on a system. 

In this particular problem subjects In group M* also did not omit 
any forces on block B (although they were merely told to "Indicate aV[ the 
forces exerted on block B by all other systems 11 and then to check that they 
had Identified all such forces), However, subjects In group M* did omit 
relevant forces In the solutions of the other problems (as Indicated In 
Table 5 and Figure 2), while subjects In group M never omitted any relevant 
forces In any of the problems. Thus the detailed description procedure 
specified by the full model Is far more reliable than the less explicit 
procedure provided to subjects In group M*. Nevertheless, the latter 
procedure still leads to better performance than that exhibited by subjects 
working without any external guidance. 

Wrong directions of forres . A second very common error exhibited 
on the pretest was that of ascribing the wrong direction to a force.' Half 
of the subjects made this error In at least one pretest solution. An 
example of this difficulty occurs In problem 1A Illustrated In Figure 4 
and described more fully In the Appendix. In this problem blocks A and B 
are connected by a thin light string which passes over a fixed pulley. 
It Is specified that the block C, which lies on top of block A, remains 
at rest relative to A without sliding off* 

Insert Figure 4 about here 
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Figure 4. Problem 1A Involving three blocks, with motion and fores 
descriptions of block C. (The friction force f, indicated by a dashed 
arrow, is frequently ascribed the wrong direction. I.e., to the left.) 
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To solve this problem, all the forces on block C must be correctly 
identified and described. However, in 83* of the pretest solutions of this 
problem, subjects asserted that the friction force on C by A was directed 
to the left , when it is irr fact directed to the right. (Indeed, if the 
friction force were directed to the left, block C would certainly ^1 ide off 
block A. It is only the friction force exerted on C by A which moves C to 
the right along with A.) 

This error appears to be the result of the following inaccurate, and 
frequently verbalized, rule used by many subjects' to determine the direction 
of the friction force: '^Friction opposes the motion of C". This rule is 
too general' and leads to correct force descriptions only under certain 
special conditions. The correct general rule is that "friction opposes 
the relative motion of the contact points"; I.e., in this case the friction 
force opposes the motion of C relative to A and must thus be directed to 
the right . Subjects In group M, who used this rule included 1n the model 
of description, never erred In ascribing the correct direction to the 
friction force. By contrast, subjects In groups H* and r made this error 
as frequently as the subjects on the pretest prcHems. 

The model (Table 1) provides not only explicit rules for correctly 
describing forces, but Includes also checks to ensure that forces have 
been described properly. One such check requires that the descriptions of 
the motion and interaction of each system by consistent. In order to 
perform this check, both the motion and interaction of each system must 
have been described explicitly, as required by the model. Such descriptions 
for selected systems have been indicated for the problems Illustrated 1n 
Figures 3 and 4. 
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The check for consistency/between motion and interaction is based on 
Newton's motion principle na ■ F which Implies that the acceleration a of 
any particle must have the same direction as the total force F on It. 
Accordingly, the detailed program Implementing the model for Group H 
contained the following direction for checking the consistency of motion 
and interaction descriptions; "In your diagrams, are the forces on the 
selected particle such that, with proper magnitudes, their vector sun can 
have the same direction as the particle's acceleration? If not, there Is 
something wrong.** 

The power of the preceding checking procedure can be Illustrated 1n 
the case of the problem of Figure 4. It Is quite easy for subjects, 
describing the motion of block C, to determine that Its acceleration Is 
directed to the right. If such a subject, describing the Interaction of 
block C, then claims that the friction force f on this block 1s directed 
to the left, the checking procedure would Immediately reveal that the 
direction of this force is inconsistent with that of the acceleration and 
roust therefore be incorrect. Thus the check of consistency between motion 
and Interaction provides a reliable means of detecting and correcting the 
common error of incorrectly ascribing the wrong direction to the friction 
fo«xe in this problem. 

The explicit qualitative comparison of motion and force diagrams 1n 
our experiments also seemed to provide sutdents with a powerful graphic 
demonstration of the meaning of Newton's motion principle. Many of the 
students in group M spontaneously reacted to this comparison with 
comments indicating a new understanding of the Implications of Newton's 
motion principle ma = F» e.g., with comments such as "Oh, that's neat! I 
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hadn't thought about It that way before!**. This kind of qualitative 
comparison procedure may thus have a substantial potential for enhancing 
students 1 understanding of physics principles, a potential which may be 
worthy of further investigation. 

Another check on the Initial theoretical description of a problem 
Involves determining whether mutual forces between interacting particles 
(i.e., "actions** and "reactions* 1 ) have been correctly described In a manner 
consistent with "Newton's third law". To be specific, subjects In group H 
were directed to do the following: "Check to make sure that all action- 
reaction pairs of forces are described as equal In magnitude and opposite 
in direction. For example, If systems A and 8 Interact, the force on A by 
B In your force diagram of A should be opposite In direction, but should 
have the same magnitude, as the force on B by A 1n your diagram of B." 

Host students, working Independently wl thout guidance In the problem 
of Figure 4,d1d correctly state that the friction force cn block A by 
block C Is directed to the left, even though many claimed Incorrectly that 
the friction fcrce on block C by block A Is also directed to the left. 
Since the model Incorporates an explicit check on the consistency of mutual 
forces, subjects working In accordance with this model detect the 
Inconsistency of such force descriptions and make appropriate corrections. 

DISCUSSION AND IMPLICATIONS 
The work discussed In this paper has a1rr»ed to formulate and validate 
a prescriptive theoretical model specifying some of the knowledge and 
procedures leading to good human problem solving In a quantitative science 
such as physics . We have focused particular attention on the generation of 
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effective Initial problem descriptions which facilitate the subsequent 
solutions of such proolems. Thus we sought to specify explicit procedures 
for generating a "theoretical problem description" which deliberately 
redescrlbes any situation In terms of the special concepts specified by 
the kno*<le<lge'^ase for the relevant scientific domain. In the science of 
mechanics these procedures specify explicitly how to describe the motion of 
any system In terms of concepts such as velocity and acceleration, how to 
describe the Interaction of any such .stem In terms of specified kinds 
of forces, how to exploit special * iledge about the properties of such 
forces, and how to check the resulting description by Its consistency *Uh 
known physics principles. 

The special experiments, discussed In the preceding pages, show that 
human subjects, Induced to follow such description procedures under 
carefully controlled conditions, do Indeed reliably generate explicit and 
correct descriptions of the motion and Interaction of systems In mechanics 
problems. Furthermore, these descriptions markedly facilitate the 
subsequent construction of correct problem solutions. 

Ihe generation of effective Initial problem descriptions Is far from 
trivial. Indeed, our experiments show that many students, after receiving 
good grades In a recent course where they received formal Instruction In 
mechanics, nevertheless generate Incomplete and/or Incorrect descriptions 
of fairly routine problems— and thus fail to solve them properly. 

As we have pointed out, these problem-solving deficiencies exist even 
if students have a good understanding of prerequisite physics concepts 
and principles. Ihey still lack the more strategic kinds of knowledge 
specified In our prescriptive model, I.e., the roeta-knowledge that It Is 
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Important to describe a problem with care before attempting to search for 
Its solution, explicit knowledge about what types of Information should be 
Included In an effective description, and explicit systematic procedures 
specifying hew to generate such a description. These kinds of knowledge 
are usually possessed by experts, although predominantly In tacit form, 
and are rarely taught explicitly In physics courses. The work discussed 
In the preceding pages shows that such knowledge can be made more 
explicit and that. If used by students, It can strikingly Improve their 
problem-solving performance. 

Our theoretical Ideas about the generation of effective Initial problem 
descriptions have been Illustrated 1n the particular scientific domain of 
mechanics. However, they can readily be extended to other scientific 
domains (e.g., to electric circuits, or thermodynamics, or even to domains, 
outside of physics) provided that they are used In conjunction with the 
particular knowledge base of the relevant scientific domain. 

The generation of effective Initial problem descriptions, discussed 
In the preceding pages, is very Important to achieve effective problem 
solving, but Is not sufficient. A complete prescriptive theoretical model 
of effective problem solving must, therefore, also deal with other central 
Issues, e.g., with decision processes facilitating the efficient search 
for a solution, with useful forms of organization of the knowledge base, 
etc. We have outlined such a more encompassing problem-solving model 
elsewhere (Reif & Heller, in press) and hope to validate other aspects of 
this model by experimental methods similar to those used In our study of 
problem description. 



Prescribing Problem-solving Processes 

34. 



The particular experimental methods, discussed In the preceding pages 
to study models of problem description, have Involved the detailed 
observations of human subjects working under "external control" In 
accordance with prescriptive models of performance (either a proposed model 
of effective performance or alternative models). This method permits one 
to explore in detail the efficacy of any proposed model of human task 
performance and to manipulate experimentally various parameters of such a 
model. Accordingly, this method may be broadly useful to study theoretical 
models specifying cognitive processes and knowledge structures for 
achieving Intellectual performance In a wide variety of domains. 

The work discussed In this paper Is highly relevant to the design oi 
instruction for teaching students Improved scientific problem-solving 
skills. Indeed, such Instruction requires a well-validated prescriptive 
model specifying how good problem solving Is to be achieved by students as 
a result of instruction. (As pointed out In the Introductory paragraphs, 
such a model must do more than merely simulate the problem-solving 
behavior of actual experts.) Our model for generating effective problem 
descriptions, together with the experiments verifying Its efficacy, Is thus 
an essential prerequisite for teaching students Important problem- 
description skills needed for good problem solving. 

Such teaching efforts would require students to Internalize, and learn 
to use habitually, control knowledge which was explicitly externalized In 
our experiments. In other words, Instructional design must use Insights 
about good performance and then deal explicitly with the processes whereby 
such performance can be learned. Indeed, our model of problem description 
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has already been quite useful In some of our practical efforts to teach 
problem-solving skills to students In physics courses. Vie hope to go beyond 
such Informal efforts to develop more explicit and systematic Instructional 
methods based on our analysis of relevant cognitive processes. 

APPENDIX 
Problems Used 1n Experiments 
The following are the three pairs of problems used in our experiments. 
Each problem was presented to a subject together with a tabular summary of 
the Information specified In the statement of the problem. 

Problem 1A 

Figure 5 shows a cart A (of mass 2m) free to move without friction 
along a horizontal table. This cart Is attached by a light string, which 
passes over a pulley of negligible mass and negligible friction, to a 
block B (of mass m^) suspended from the other end of the string. A block 
C (of mass m) lies on top of cart A. The coefficient of static friction 
between A and C Is p. What Is the maximum value of m^ for which block C 
will remain on the cart without sliding? 



Insert Figure 5 about here. 



Problem IB 

Figure 6 shows a cart A, of mass m^, which moves with negligible 
friction along a horizontal floor when It Is pushed to the right by an 




3Fa 




Figure 5. Diagram for problem 1A. 
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applied force of magnitude F Q . A small block B, of mass m B , Is 1n contact 
with the right vertical side of the cart. The coefficient of static 
friction between the block and the side of the cart has a value \t. How 
large must be the magnitude F Q of the applied force so that the block re- 
mains at rest relative to the cart, without slipping down? 



Insert Figure 6 about here. 



Problem 2A 

A pendulum bob, of mass m, swings In a vertical plane at the end of a 
string of negligible mass fastened to the celling. At the highest point of 
Its swing, the pendulum Is In the position shown In Figure 7 f with the 
string at an angle 0 from the vertical. What Is the magnitude of the 
tension force exerted on the bob by the string at this Instant? 



Insert Figure 7 about here. 



Problem 2B 

An object of mass m slides along a circular track with negligible 
friction. When the object passes the point P In Figure 0, the magnitude 
of the force exerted on the object by the track Is 3mg//f. What Is the 
magnitude of the object* s acceleration at that Instant? (Use the values: 
sin 45° • cos 45° - l/JT. ) 

Insert Figure 8 about here. 
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Figure 6. Diagram for problem IB. 
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Figure 7. Diagram for problem 2A. 




Figure 0. Olagram for problem 2B. 
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Problem 3A ^ 

A man, of mass m, stands on a board, of mass M, which he previously 
placed on a mud-covered hilly sj^rtvCe making an angle 6 with the hori- 
zontal. The man holds on to a rope (of neglibtble mass and parallel to 
the surface of the hill*) whose other end 1s fastened to a wall at the V>P 
of the hill. (See Figure 9.) The man -finds, to his dismay, that the board 
beneath him starts sliding down the hill. The coefficient of sliding fric- 
tion between the ma^s shoes and the board Is Up and the coefficient of 
sliding friction between the board *nd the surface of the hill Is v^. 
What 1s the magnitude of the acceleration a g with which the board beneath 
the man slides down the hill while the man, holding on to the roper remains 
at rest relative to the grdwnd?* 



Insert Figure 9 about here. 



ProblqMB 

Two blocks A and 8 are connected by a light flexible string passing 
around a frictlonless pulley of negligible mass. (See Figure lO.i) Block A 
has a massMtu and block 8 has a mass. m^. The coefficient of sliding fric- 
tion between tfie two blocks, and also between block 8 and the horizontal 
table below 1t» has a value u. WhaMs the magnitude F Q of the force 
necessary to^null block B to the left at constant speed? j 1 



\nsert Figure 10 about here. 
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Figure 10. Diagram ,or problem 3B. 
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